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@ MMIwdandspparatusfbrditpla^ng a single parameter Image. 

@ A method and apparatus for displaying an image which 

has a wide dynamic range. Low spatial frequency com- , -i- . | ■ 

ponents f(x,y) of the image are extracted from the image j— . ' 

■ignsl and are presented as a color overlay which tints an i I ^ 

intensity modulated display of local high spatial frequency 
image components a(x,y). 



a «tX.T) ,80 



ID 

S 

n 

N 
O 



FIG.2 



0213666 

PHA..21-279 ^ 19.2.86 



Method and apparatus for displaying a single parameter image. 



The invention relates to a method for displaying 
an image from an image signal which includes values of a 
parameter at a large number of image points and which has 
a wide dynamic range, comprising the steps of filtering the 
image signal to extract, at each image point, a low spatial 
frequency background signal component and a rapidly varying 
local signal component and compressing the dynamic range 
of the local signal component. 

The invention also relates to an apparatus for 
displaying an image comprising! 

means which produce an image signal which includes 
parameter values at a large number of image points and which 
has a wide dynamic range; 

filter means which extract a low spatial frequency, 
background component of the image signal; 

display means which map each image point into a 
corresponding pixel on an image display; and 

means which modulate the intensity of each pixel 
to represent the high spatial frequency components of the 
image signal at the corresponding image point. 

The invention is particularly useful for displaying 
medical diagnostic images which are produced, for example, 
by echo ultrasound or other digital imaging modalities, 
Under ideal conditions, the human visual system is only able 
to perceive from four to six bits of dynamic range (from 16 
to 6k distinct gray levels) in a monochrome image. The actual 
number of bits perceived is further reduced in the presence 
of additive glare (background lights) which usually means 
that a darkened room is required for presentation of images 
with a large dynamic range. The perceived dynamic range of 
an image may be increased by reducing the amplitude of lower 
spatial frequencies, but this dynamic range reduction is 
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detrimental to effective diagnosis of medical images, 
particularly ultrasound images, vhich makes use of the 
presence of shadowing and/or bright-up. 

Many algorithms for compressing the dynamic range 

5 of a one-dimensional image exist in the prior art. 

For example, homomorphic filtering vhich can emphasize local 
high frequency variations in an image while suppressing low 
spatial frequency variations is described in Oppenheim, 
Schaffer and Stockham, "Nonlinear Filtering of Multiplied 

ID and Convolved Signals", Proceedings of the IEEE, Vol. 56, 
pages 1264-1291 (1968) and in "Digital Image Restoration", 
Andrews and Hunt, Prentice-Hall Inc., 19T7t which are 
incorporated herein, byr^e fere nee , as background information. 
In one such technique, the average value of pixels in the 

15 local two-dimensional region surrounding each pixel is 
computed and is divided into the value of the individual 
pixel. The quotient represents the local, high frequency 
variation and is used to intensity modulate the display of 
the pixel. This results in a compression, similar to A&C 

20 compression of audio signals. However, these techniques 

generally "throw-away" the low spatial frequency, background 
infosrmation from the image. 

It is an object of the invention to provide a 
method and an apparatus for producing images that combine 

25 the features of an extended perceived dynainic range and a 
good display of low spatial frequency information. 

To achieve this object tliP method according to the 
invention is characterized in that it further comprises the 
steps of displaying each image point by modulating the 

30 intensity of a corresponding image pixel to represent the 
compressed local signal component at the image point and 
modulating the color of the pixel to represent the 
background signal component. 

The apparatus according to the invention is 

35 characterized in that it further comprises color modulating 
means for modulating the color of each pixel to represent 
the background component of the image signal at the 
corresponding image poin--. 
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In accordance with the invention, low frequency 
background information is displayed as a color tint which 
overlays an intensity modulated display of a high spatial 
frequency, compressed image. The invention thtis converts 
B low frequency information, which is normally discarded by 
compression, into another form which the observers can 
simultaneously perceive in conjunction with the compressed, 
high frequency image. 

The invention will now be described in detail by 
10 reference to the attached drawings in which: 

Figure 1 is a simplified chromaticity diagram which 
illustrates the invention; 

Figure 2 is an image display system which incor- 
porates the invention; and 
,5 Figure 3 are plots of RGB multiplier values. 

It is well known ihat pseudocolor enhances human 
perception of gray scales and enables an observer to 
quantify a single parameter image. It has also been shown 
that color can allow the eye-brain combination to form use- 
20 ful correlations on multidimensional image data, if it can 
be used in a pleasing manner. However, many medical radio- 
logists do not like pseudocolor images. 

It is known that separate use of red, green and 
blue to image three independent variables leads to confusing 
25 images. A more natural presentation is used in commercial 
color television and in map making where a primary image 
is shown as a high (spatial) resolution intensity image and 
secondary parameters are visualized by color tinting 
(which typically has less spatial resolution than the 
30 primary image). Thus, the hue (color) and the saturation 
(purity of color) can be used to present two independent 
low-resolution variables which are superimposed on a high 
resolution intensity image. 

Figure 1 schematically illustrates a two-dimensional 
35 chromaticity space of hue H and saturation S in polar 
coordinates. In the figure. S = 0 is white (zero color 
saturation) and the circle S = 1 represents pure mono- 
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chromatic colors (fully saturated) such as blue (b) , 

yellow (y) , red (R) and violet (V) , In this model, 

locations near S s 0 are pastel colours such as pink (P) 

and sky blue (SB), 
6 In the prior art, three parameters of position 

in an image {such as a(x,y) , f(x,y) and e(x,y) vere 

respectively assigned to Intensityt Hue and Saturation as, 

for example: 

Intensity : l(x,y) = a(x,y) (l) 

10 Hue : H(x,y) = f(x,y) (2) 

Saturation: S(x,y) = e(x,y) (3) 

where K^, K^, and are constants. 

The simplest use of these relations is to set 

S = 0 (which implies that the hue is irrelevant) , Black and 
15 white intensity images are thus produced from the function 

a(x,y) , 

In the usual prior art pseudocolor display, 
the parameter, l(x,y^As a constant, S is unity (fully 
saturated color) , and the parameter f (x,y) is imaged with 

20 hue as the only variable. Many people find such images 
distasteful. 

In a more acceptable prior art method, "color 
tinting" of a gray scale image is accomplislied using 
all three equations. If two parameters are of interest, 

25 it is common to set S equal to a constant and to use l(x,y) 
and H(x,y) as the parametric variables. Color tinting of 
a black and white image usually conveys low resolution 
information as an overlay through which the observer can 
see an image of intensity information a(x,y) in the same 

30 manner as a color tinted black and white photograph. 

If S is chosen as unity, this scheme is still unsatisfying 
to many observers. More pleasing images are formed if S 
is set to a small value which presents all colors as 
unsaturated pastels. 

36 My copending patent application No. (PHA.21,278) 

discloses a method and apparatus for simultaneously dis- 
playing two parameters in an image which can advantageously 
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be utilized with the present invention. A combination of 
hue and saturation coding is used to overlay a display 
of a secondary parameter display on an intensity modulated 
display of a primary parameter. 

In accordance with that invention, a second 
parameter f(x,y) is used to tint an intensity image 
l(x,y) = a(x,y) by controlling a combination of hue H(x,y) 
and' saturation s(x,y) at each pixel so that the hue of the 
pixel is determined by the sign of the deviation of the 
; value of the second parameter from a reference value, f^, 
and the saturation of the pixel is proportional to the 
absolute value of that deviation. For example: 

when f (x,y) < f^ : H(x,y) = Blue 

ffj - f(x,y) 
S(x,y) = (f^ _ f . ) 

^0 rain' 

and when f(x,y) ^ f^ : H(x,y) = Red 

f(x,y) - fo 

^^^•^^ = ( W - ^o) 

Where C,, f,,,, f^^^, and f, are constants. Thus as f 
increases from its minimum t o its maximum, the chromatxcxty 
follows a path, as illustrated by the broken arrow A in 
Figure 1 , from a relatively saturated blue B through the 
pastel shades of blue SB through white (S=0) and then through 
a pastel P and into a relatively saturated red color R. 
Any radial path inward from a saturated color to white 
and out again along another radial path to some contrasting 
color may be used. In a preferred embodiment, the path 
begins and ends at somewhat unsaturated pastel colors as 
this seems to provide a more pleasing image. 

In a preferred embodiment of the present invention, 
the low frequency background variation of a compressed 
i image is used as a secondary parameter to modulate the hue 
and saturation of the pixels so that, for example, shadow 
areas of the image are displayed as ice blue, average 
density regions of the image are displayed as shades of 
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gray and highlights of the image are displayed with an 
intense red overlay. 

The principle features of the displayed image 

are: 

5 l) when the low frequency component does not deviate from 
its reference or equilibrium value, then the image 
is black and white without color tint} and 
Z) the color overlay has a linear (one dimensional) 
directional sense (for example* from blue to red) 
10 which may be mentally associated as left-right, up-down, 
hot-cold, good-bad, big-little, etc. In contrast, 
conventional hue modulation along has "circular loop" 
connotations which can sometimes be disorienting. 

Figure 2 is a block diagram of an image display 
15 system which incorporates the invention, A scanner 10 
produces a stream of digital data wherein each word 
represents the value of an imaged- parameter at a discrete 
point in an image matrix. The scanner 10 may, for example, 
be an echo ultrasound scanner, an X-ray computed tomography 
20 scanner, a magnetic resonance imaging device, a digital 
subtraction radiography system, or a similar medical 
imaging device. Alternately, the scanner 10 could represent 
the output of an electron microscope, a computer graphics 
imit, or a radar system,- At the output of the scanner 10, 
25 the data which represents points in the image can each 
assume more than from 16 to 64 discrete values and each 
word is therefore represented by more than from 4 to 6 bits. 
Typically, eachlmage point will be represented by from 8 
to 32 bits. Data from the output of the scanner 10 is 
30 stored in an image memory 20. The image memory contains 
a discrete, addressable memory cell for each point in the 
image . 

The contents of the image memory 20 are scanned, 
by addressing the memory on an image point-by-image point 
35 basis and the successive values at image points 22 in the 
image matrix are fed to a first input of a digital dividing 
circuit 30. At the same time, the values of all image points 
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in a local area 2k of tlie matrix, vhich surrounds the 
addressed image point 22, are fed to an average value 
computing circuit hO, The aversi.ge value of the image points 
in the area 24 is a measure of the low spatial frequency 
5 background components f {x,y) at the addressed image point 
22. The high order bits from the output of the averagevalue 
circuit kO are fed to a second input of divider circuit 30, 

The average value circuit kO and divider circuit 30 
function as a two-dimensional, homomorphic lov-pass filter 
10 which extracts a slowly varying background component from 
the image signal. Alternately, other known types of low-pass 
filters may be utilized. In some applications it is also 
possible to extract the background component of the image 
signal using a one-dimensional filter. For example, the 
15 background component can be extracted from echo-ultrasound 
or radar signals with a one-dimensional low-pass filter 
which operates on the logarithm of the A~line signals in 
the time domain. 

Alternately, if the image signal is subjected to 
20 logarithmic compression before it is stored in the image 
memory, a subtraction circuit can be utilized in place of 
the divider circuit 30. 

The divider circuit 30 divedes -the first , input, 
which is the value of image point 22, by the low frequency 
25 component f(x,y) to yield a function a(x,y) which represents 
the high spatial frequency, low order bit variation at 
image point 22. The high order bits of the low spatial 
frequency component, f(x,y),and the low order bit of the 
high spatial frequency component, a(x,y) are combined and 
30 used to address the respective contents of three read-only 
memories (ROM's) 50, 60 and 70. Read-only memories 50, 60 
and 70 respectively contain look-up tables which determine, 
from the values of the functions f(x,y) and a(x,y) the 
values of the red, green, and blue components of a 
35 corresponding pixel in a display of the image. The outputs 
of read-only memories 50, 60, and 70 are fed, respectively, 
through digital-to-analog converters 80, 90 and 100 to the 
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red, green, and blue inputs R, G, B of an RGB CRT display 
110, A sweep control circuit 120 generates horizontal and 
vertical sweep signals to produce a raster scan on the 
display 110 and to simultaneously address the scan-in image 

S memory 20, so that the image memory cells 22 in the image 
memory 20 are mapped to corresponding pixels on the face of 
the CRT in the display 110, 

In preferred embodiment of the invention, the 
look-up tables in the ROM memories 50, 60, and 70, 

10 respectively generate a red signal, R(x,y) , a green signal 
G(x,y),and a blue signal B(x,y) in accordance with the 
formulas 

I(x,y) = K^a(x,y) 

RCx,y) « PR(x,y) I(x,y) 
16 G(x,y) « Pc.(x,y) l(x,y) 

B{x,y) = PgCx.y) l(x,y) 
where the multiplier values Pj^, and are all less 
then unity and are functions of f(x,y) determined according 
to the mapping illustrated by the straight lines in Figure 3» 

When P . differs from zero, maximum saturation is not 
mm 

obtained. When the output of the average value circuit hO 
is equal to the nominal value of the image intensity, f^, 
all three color guns are balanced to produce a nominally 
white pixel. In that case Pj^ = s= p^ = P^. 

It is also possible to obtain a particularly 
pleasing modulation schema by varying the value of P^. 
That is to say the value of the intensity (l = R+G+B) is 
in fact slightly modulated by f(x,y). 



35 



0213666 

19.2.86 



CLAIMS 



1 • A method for displaying an image from ail image 

signal which includes values of a parameter at a large 
number of image points and which has a wide dynamic range, 
comprising the steps of filtering the image signal to ' 
extract, at each image point, a low spatial frequency 
background signal component and a rapidly varying local 
signal component and compressing the dynamic range of the 
local signal component, characterized in that the method 
further comprises the steps of displaying each image point 
by modulating the intensity of a corresponding image pixel 
to represent the compressed local signal component at the 
image point and modulating the color of the pixel to re- 
present the background signal component, ^ : v, 

2. A method as claimed in Claim 1, characterized in 
that the filtering step comprises filtering the image 
signal with a low-pass filter. 

3. A method as claimed in Claim 2, charaicterized in 
that the filtering step comprises filtering the image • 
signal with a two-dimensional low-pass filter, \ 

^. A method as claimed in Claim 2 or ,3, chdxadterized 

in that the low-pass filter is a homomorphic filter, 
5. A method as claimed in any one of Claims 1-4, 

characterized in that the step of modulating the color of- 
the pixel comprises 

displaying the background signal by modulating » 
the hue of the corresponding pixel to a first tdlot- whfen 
the background signal is greater than a predetermihed 
reference value, modulating the hue of said pixel to a 
second, complementary color when the background isignal is 
less than the reference value and mbduXatlng the saturatibh 
of the color of the pixel in proportion to the- absolute 
value of the deviation of the background "signal firom the 
reference value.: 
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6. A method as claimed in Claim 5, characterized in 
that the first color is red and the second color is blue. 

7. A method as clainnjd in any one of Claims 1-6, 
characterized in that the image signal represents a medical 

S diagnostic image, 

8. Apparatus for displaying an image comprisings 
means which produce an image signal vhich includes 

parameter values at a large number of image points and 
which has a wide dynamic range; 
10 filter means which extract a low spatial frequency, 

background component of the image signal; 

display means which map each image point into a 
coresponding pixel on an image display; and 

means which modulate the intensity of each pixel 
16 to represent the high spatial frequency components of the 
image signal at the corresponding image point; 
characterized in that the apparatus further comprises: 

color modulating means for modulating the color 
of each pixel to represent the background component of the 

29 image signal at the corresponding image point. 

9, An apparatus as claimed in Claim 8, characterized 

in that the color modulating means are designed to display 
the low frequency, background component by modulating the 
hue of the corresponding pixel to a first color when the 
2S background component is greater than a predetermined 
reference value, modulating the hue of said pixel to a 
second, complementaary color when the background component 
is less than the reference value and modulating the 
saturation of the color of the pixel in proportion to the 

30 absolute value of the deviation of the background component 
from the reference value. 

10. An apparatus as claimed in Claim 8 or 9, 

characterized in that the filter means comprises a two- 
dimensional homomorphic filter, 
35 11, An apparatus as claimed in any one of Claims 8 - r 

characterized in that the means which produce the image 
signal comprises an echo-ultrasound scanner. 
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